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ABSTRACT 

The purposes of the study n deler aine psychometric 
characteristics of the Series Learning Po :ial Test, the effects of 
Learning Potential training on Series sec, ^ and the relationship of 
Series scores to IQ, race, social class, and reading achievement. The 
Series Test was administered to students in 79 classrooms in five 
Connecticut towns which differed in racial and socioeconomic 
composition. The test was shown to be highly reliable, and the two 
forms were found to be statistically equivalent. Bifficulty levels of 
several items indicated a ceiling effect reflected in total scores • 
Training was found to be effective with second and third graders from 
lower class towns and first and second graders in middle class towns. 
Series scores were positively related to IQ and reading scores, and 
students who were white or middle class attained higher Series 
scores. For these reasons, as well as the ceiling effect, the Series 
test appears to be l^ss useful than other tests as a measure of 
Learning Poter iial. (Author) 
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THE SERIES TEST AS A MEASURE OF LEARNING POTENTIAL 



Abstract 



The purposes of the study were to determine psycho- 
metric characteristics of the Series Learning Potential test/ 
the effects of learning Potential training on Series scores^ 
and the relationship of Series scores to IQ, race, social 
class / and reading achievement. The Series Test was 
administered to students in 79 classrooms in five Connecticut 
towns which differed in racial and socioeconomic composition. 
The test was shown to be highly reliable, and the two forms 
were found to be statistically equivalent. Difficulty 
levels of several items indicated a ceiling effect reflected 
in total scores. Training was found to be effective with 
second and third graders from lower class towns and first 
and second graders in middle class towns • Series scores 
were positively related to IQ and reading scores, and 
students who were white or middle class attained higher 
Series scores. For these reasons, as well as the ceiling 
effect, the Series test appears to be less useful thsm other 
tests as a measure of Learning Potential • 



THE SERIES TEST AS A MEASURE OF LEARNING POTENTIAL" 



Louise Corman and Milton Budoff 
Research Institute for Educational Problems 



Budoff (1970) has described a learning potential (LP) 
procedure for assessing ability among low-IQ, low-SES 
children based on a process-oriented conceptualization of 
intelligence. The focus of the LP paradigm is on the 
child's trainability , i.e., his ability to improve performance 
on reasoning problems following a systematic learning 
experience. Reasoning is viewed as the critical ability. 
The reasoning tasks are administered in a "test-train-test" * 
sequence. Training allows the low-SES child to understand 
how to solve the problems when the contents of the problems 
may be strange and the appropriate strategies are not 
readily apparent to him. 

Training is hypothesized to be particularly critical 
for the child from a poor and/or nonwhite background, who 
may learn different cognitive strategies in different 
expressive formats than those presximed to be available by 
the tests. The training helps the child to narrow the 
cognitive gap between his previously learned problem- 
solving strategies and those implicit to the problems 
he must ordinarily solve on the middle-class-biased tests 
he encounters. The test-train-test paradigm also minimizes 
the artificiality of the test situation. The repeated 
contacts with the materials in a context of support and 
teaching allows the school- failing child to develop a 
sense that he can be competent. Without this competence 
boost, he tends not to perform at his best, implicitly 
expecting failure (Zigler, 1966). The essence of this 
assessment strategy, then, is ■'to impose some control on 
the potentially negative effects on his test performance 
of prior life experiences. 

The pretest reflects the subject *s present level of 
functioning, and his existing ability to work with the 
problems. Posttraining scores reflect the child's ability 
under optimized conditions in which all subjects are 
familiar with the task and its demands, have had success in 
solving problems similar to those on the test, and have 
had the opportunity to learn and apply relevant strategies. 
Budoff and Gorman (in press)have shown that EMRs' pretest scores 
on Kohs Block Designs correlate highly with Stanford-Binet 
and Wechsler scores and other indices of psychosocial 
vulnerability associated with socioeconomic status. Post- 
training scores were correlated only with performance 
scale scores. 
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To date, nonverbal reasoning tasks have been used since 
these are not dependent on language^ which represents one 
major area of these children's difficulties. Three nonverbal 
tasks have been employed in assessment of LP: an altered 
version of the Kohs Block Designs (Budoff, 1969), Raven* s 
Progressive Matrices (Budoff, 1970), and the Series Learning 
Potential Test (SLPT, Babad & Budoff, in press). 

The SLPT, used in the present study, is a group test 
for the primary and elementary grades. Its major task is 
the completion of series of pictures or geometric forms / 
arranged in a pattern in which the figures change systematically. 
Each item presents a horizontal row of cells each of which 
contains a stimulus figure. One cell is left blank. The 
subjects must identify among the multiple choices on the 
right the picture which best completes the series. Four 
concepts may vary in a series: semantic content (meaningful 
or geometric figures) r size (large/small), color (black/ 
white), or orientation (up/down, or left/right). The 
concepts may vary symmetrically or asymmetrically and the 
blank space may be placed in any part of the series. The 
hardest items are those in which the blank space appears 
early in the series, and the concepts change asymmetrically. 

Two 65-item forms of the test are used, with items 
corresponding in concepts but with different pictures in 
similar arrangements. None of the 17 coaching items is 
identical to any of the 130 test items. The test contains 
several types of items. Forty items (Picture Series) 
consist of meaningful pictures ranging from easy items (two 
concepts are arranged symmetrically and the blank space 
appears at the end of the series) to more difficult ones 

(asymmetric alternation of three concepts, blank space in 
initial position) . Improvement in solving the meaningful 
picture series on the posttest indicates the child can solve, 
nontrained instances of the trained items. Ten items 

(Geometric Series) with geometric figures discern whether 
S can transfer' the strategies learned in training with 
meaningful pictures to dissimilar stimuli. Fifteen double- 
classification items, including five matrices in meaningful 
pictures (Picture Matrices) and ten in geometric symbols 

(Geometric Matrices) are presented in a matrix format, test:' 
for generalization of the learned strategies to problems 
that require the same reasoning process in a different 
arrangement. The strategies may also be mediated differently. 

Specific purposes of this study were to determine (a) 
psychometric characteristics of the two Series forms, (b) 
differences in initial performance by grade level (grades 1 
to 4), (c) effects of training, (d) the relationship of IQ, 
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race, and social class to performance on the Series Test, and 
(e) the relationship of reading and vocabulary scores to 
scores on the Series test* 

Method 

Subjects 

The Series Test was given to first through fourth 
grade students in 79 classrooms in Darien^ Hartford, Ledyard, 
Stamford, Wilton^ and Westport (one parochial school only), 
Connecticut. The majority of students in Hartford and 
Stamford were black (9 8.7% and 76*2%, respectively) and 
from low socioeconomic backgrounds. Students in the other 
four towns were predominantly white and middle class (Table 
8) . The total sample was evenly divided among males and 
females and ranged in age from approximately six to ten 
years. 

Procedure 

Four different assessment procedures were used. In 
the majority of classrooms (50) all students received Form 'A 
as pretest, were trained, and took Form B as posttest. 
Half the students in four classrooms in Ledyard got Form A 
as pretest and Form B as posttest, with no training between 
the two tests; the other half got Form B, then Form A, 
with no training. One classroom in Stamford was assigned 
Form B as pretest and Form A as posttest, with training 
given between the two tests. The remaining classrooms (24) 
were used as a "training study" sample so that the effects 
of training could be assessed. Each student in the training 
study was randomly assigned to a trained or non-trained 
group and to Form A or Form B. These students received 
the same test form for pre- and posttesting. The training 
study sample consisted of five first grade / seven second 
grade, nine third grade, and three fourth grade classrooms 
from five of the Connecticut towns (Westport was not repre- 
sented.) . Posttesting took place within one week after 
pretesting. 

Five strategies were taught and practiced during training: 
The students learned to identify each concept that changes. 
They learned to "sing the tune" for each concept, one at 
a time as an organizational or chunking aid to identify 
the pattern of each concept. 

To reduce the memory load in a multi-concept item, the 
student crossed out the wrong choices for each concept. 
The child learned to reverse -the^ direction ill which the 
tune is smg when the location of^^^he blank space calls 
for such reversal, e.g., blank at the beginning of a 
series. \ 



1. 
2. 



3- 
4. 
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5. The child learned to identify the starting point of a 
concept when the series starts in the laiddle of the 
pattern. 

All 17 problems were successfully solved by the end of the 
30- to 45-minute training session. Appendix A has the 
instructions for administration and training on the SLPT. 

Information pertaining to race, social class, scores 
on a group IQ test, and scores on the Gates-MacGinitie 
Reading Test was obtained on all students in the 79 class- 
rooms for whom this data was available • 

Results 

Test Characteristics 



To assess the psychometric characteristics of the two 
test foirmsr test-retest reliabilities were calculated, and 
correlations between scores on the two forms were obtained 
to provide a measure of form equivalence. In addition, item 
analyses and factor analyses were calculated on each form 
before and after training. 

The sample for the test-retest reliabilities consisted 
of 120 nontrained training study subjects for Form A and 93 
similarly selected subjects for Form Bj. Form equivalence 
was obtained for all subtests and the total test by correlating 
the pre- and posttest scores of the 106 students in the four 
Ledyard classrooms who received no training. 

The sample for the item and factor analyses before 
training consisted of all students who received as pretest 
the form being analyzed, as well as some nontrained students 
who received that form on the posttest but not on the 
pretest* For Form A the sample was 1416 students, including 
the 50 classrooms who got AB and training, the students in 
the four Ledyard classrooms who got BA.or AB and no training, 
and half of the training study sample who got Form A. The 
sample for Form B was much smaller, since the 50 classrooms 
who got form A, training, and Form B had to be excluded. 
This sample consisted of 327 students, including students 
in the four Ledyard classrooms who got Form B, then Form A, 
or Forms A then B with no training, half of the training 
study sample who got Form B, and the Stcimford class who got 
Form B then A and training. 

The item and factor analyses after training were calculated 
from posttest responses of 177 students for Form A and 1115 
students for Form B. The sample for Form A comprised 
trained students in the training study group who got ^^orm A 



and the Stamford class who ;cct Form B, theri A» and training. 
For Foaon the sainpie included students in the 50 classrooms 
who got Form A, then B and training and trained students 
in the training study group who took Form B. 

In order to perform item and factor analyses, all 
item re&ponses v/ere dichotor'dsed as either correct or 
incorrect. KR20 reliability coefficients were determined 
with the samples employed in rhe pretest item analysis. 
KR20, test-retest^ and alternate form reliability coefficients 
are presented in Table 1. All three types of reliability 
xwere high for the total test. Test-retest and alternate 
form coef f icien-jps for the separate subtests were lower but 
Wx:ire in the moderate range* 



Insert Table 1 about here 



Table 2 shows the difficulty levels of Series items on 
each form before and after training. The number of options 
varied on different items; therefore, in order to. compare 
difficulties across items the difficulty levels presented 
in this table were corrected by subtracting the chance score 
from the percentage obtained v/hen each item had been con- 
sidered either right or wrong- It can be seen that the 
majority of items were either very easy or very difficult; 
few items had difficulties between .45 and .55- Although 
the percentage of students who passed many items rose after 
training ; training had no effect on the most difficult 
items, most of which were on the Picture Series Subtest. 



Insert Table 2 about here 



In the factor analyses on the 65 items / four factors 
were extracted, in accordance with the theoretical structure 
of four subtests. Loadings of items on the first principal 
component betore and after training are presented in Table 
2 beside" the item difficulties • It v;as expected that items 
which were originally difficult would have higher loadings 
on the first principal component after training, because 
training might have reduced difficulties of these items 
and more closely aligned them with what the t'^st m.easures. 
It was also thought' that loadings of initially easy items 
on the first principal component would be reduced after 
training. Neither of these expectations was borne out with 
any consistency since training had little effect on the very 
easy or very hard items* 

Both the difficulty level and loading of any given item 
were comparable for the two forms, reflecting the parallel 
construction of the tests • 
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KR20^ Test-Retest ar^d Alternate Form Reliability Coefficients 



for the 


Series Tes 


t 








i 


Form 




Form 


B 


Al ternate-form 




N 




N 




N 


KR20 


.95 


1416 


. 95 


327 






Test-retest 














Total test 


.87 


120 


.90 


93 


.84 


106 


Picture series sxabtest 


.83 


120 


.82 


93 


.75 


106 


Geometric series sxabtest 


.79 


120 


- 83 


93 


.71 


106 


Picture matrix subtest 


.69 


120 


..78 


93 


.67 


106 


Geometric matrix subtest 


.70 


120 


.80 


93 


.76 


106 
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Table 2 

Corrected Diffic^.ilfy Levels and Loadings on First Principai Comporsent 

of A].l Series IteniS 



Item 



Difficulties'" 



Loadings 



Before training After trair.ing 
Form A Form B ForTn' A Form B 



Before training After training 



Forrr. A Form 3 Forni A Form B 



1 
2 
3 

5 
6 
7 
8 
9 
10 
11 
12 
13 

m 

15 
16 
17 
18 
19 
20 



.73 

.72 

.39 

.50 

,49 

AH 

.58 

.1^3 

.HI 

.48* 

.44 

.S6 

.38 

.19 

.29 

.39 

.23 

.41; 

.32 

.56 



.74 
,71 
.56 
.57 
.55 
.45 
.61 
.50 
.47 
.49 
.44 
.37 
.41 
.19 
.32 
.47 
.30 
.57 
.40 
.61 



.73 
.67 
.57 
.55 
.57 
.57 
.61 
.59 
.57 
.5U. 
Jig 

.48 
.48 
.22 
.44 
.46 
.32 
.51 
.38 
.50 



.74 
.73 
.66 
.66 
.67 
• 6 J::* 
.66 
.64 
.55 
.58 
.53 
V.'52 
.57 
.34 
. 5 3 
.58 
.46 
.70 
.56 
.65 



.19 
.11 
.63 
.51 
.62 
.73 
.48 
.73 
.60 
.5U 
.64 
.59 
. 56 
. 37 
.62 
.44 
.56 
. 56 
.65 
.43 



-.13 
-.26 
-.51 
- . 53 
-.57 
-.66 
-.33 
-.70 
- . 50 



by 
.59 
.53 
.68 
.42 
.64 
.55 
.54 
.33 
.70 



,17 
.37 
.65 
.51 

.69 



.58 
.55 
.57 
.67 
.57 
.55 
.31 
.65 
.52 
.50 
.52 
.66 
.38 



-.22 
-.25 
-.54 
-.57 
-.54 
-.56 
-.42 
-.65 
-.48 
-.58 
-.59 
-.55 
-.62 
-.33 
-.57 
-.41 
-.53 
-.38 
-.65 
-.44 
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Table 2 (ecntinued) 



Item^ Ci ff iculties""" Loadings 



Before training After training Bafovx^ training Af-^er training 



FcrD A Fori:: B Fori? A Form B Form A Forni E Form A Forra B 



21 ,i|6 .^7 ,60 .60 -,57 -.57 -,51 -.55 

22 .32 .34 ,35 * .46 -.55 -.53 -.54 -.51 

23 .38 .46 ,46 .60 -.62 -,59 -.66 -.65 

24 .53 c51 .52 .62 -.55 -.59 -.54 

25 .32 .36 ,34 .42 -.45 -.55 -.54 -.51 

26 .38 .42 .47 .52 -.49 -.44 -.56 -.45 

27 .09 .10 .19 .IB -.30 -.30 -.28 -,26 

28 -.02 -.04 ,07 .OB -.13 -.15 .07 -.02 

29 ,04 .18 ,01 .30 -.26 -.34 -.40 -.44 

30 .03 ,03 .12 .10 T.15 -.09 -.05 -.01 

31 -.08 .03 -.05 .05 -.14 -.19 -,07 -,22 

32 ^ .00 -.01 .04 .06 ' .06 -.02 -.13 -.00 

33 .31 .32 ,33 .45 - .'48 -.52- —.34 -,45 

34 .10 .13 .16 .15 -.13 -.11 -.13 ^-*16 

35 .03 .11 .08 .19 -.18 -.31 -.35 -.34 

36 .40 .39 .50 .55 -.68 -.73 -.61 -.61 

37 .01 -.02 .07 -.00 .03 .03 .03 .02 

38 .11 .15 .10 .22 -.37 -.i+0 -.30 -.35 

39 .10 .11 .18 .17 -.26 -.33 " -.28 -.25 

40 .05 .10 .11 .17 -.13 -.08 -,14 -.14 

41 .45 .52 .50 .59 -.56 -.50 -.50 -.55 

42 .36 .40 .40 .51 -.71 -.57 . -.58 -.67 



Table 2 (continued) 



Item 



Leadings 



43 

U'l 

45 

46 

47 

48 

49 

50 

51 

52 

53 

54 

55 

56 

57 

58 

59 

60 

61 

62 



Before trair.ir.g After' rr-ainirig 



ForiTi A Fcrm B Fc:-ir. A ''orm T> 



.21 
.29 
.18 
.05 
.1+6 
.18 
.35 
.07 
.59 
.39 
.20 
.24 
.31 
.54 
.45 
.23 
.06 
-.04 
.21 
.30 



. IB 

. 33 

-IS 

.11 

.44 

.13 

.33 

.09 

.58 

.43 

.26 

.26 

.34 

.55 

.45 

.25 

,13 

.06 

.19 

.29 



.lb 

.19 
>11 
.^i-S 
.15 
.37 
.08 
.Gi 
.U7 
.20 
.30 

.55 
,47 
.23 
.08 
-.04 
.22 

. 0^ 



. 33 
.42 
.19 
.16 
.57 
.29 
.47 
,20 

.G& 

.56 
, 41 
.42 
.4U- 
,62 
.57 
.36 
.21 
.04 
.26 
.40 



Before trainivig Aftev training 



Forrr. A Foi'm B Foi'ir. A Form 3 



-.58 



.09 
. 59 
.52 
.54 
.45 
.42 
.53 
.56 
.61 
.59 
.45 
.53 
.63 
.25 
.13 
.60 
.69 



-,5e 

-.21^ 

-.24 

-.55 

- . 54 

-.57 

-.!+9 

-.43 

-.62 

-.67 

-.66 

-.66 

-.53 

-.66 

-.67 

-.37 

-.20 

-.59 

-.78 



-.69 

-:.27 

-.03 

-.51 

-.59 

-.63 

-.48 

-.45 

-.50 

-.56 

-.62 

-.69 

-.55 

-.73 

-.68 

-.36 

-.03 

-.56 

-.66 



-.59 

-.65 

-.25 

-.13 

-.53 

-.58 

-.62 

-.49 

-.45 

-.64- 

-.58 

-.68 

-.58 

- .51 
-.60 
-.65 
-.4-2 
-.28 

- .58 
-.72 
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To. 

Item . 




DJ f f icultr.as' 


training 




Load 


ings 




Before 


training After 


Be for a 


training 


After 


trainxBg 


Form A 


Forr; B Porm . 


h Forrr. Hi 


Fcrr: A 


Forr':. B 


For Hi A 


Forn 3 


63 


-.01 


.02 -.06 


,02 


-.33 




-.37 


-.35 




.Ik 


.17 ,16 


.23 




-.57 




-.53 


65 


.20 


.22 .24 


.31 




-,57 


-•61 


-,49 


N 


1416 


327 177 


1115 




327 


177 


Ills 


a 


Items 1 to 


40 are Picture 


Ser^ies. -t-i to 


50 are 


Gecmetri 


c Series , 51 



to 55 are Fixture Matrix, and 56 to 65 and Geometric Matrix. 

^Chance ^scores have been subtracted from obtained difficulty levels^ 
resulting in negative difficulty levels in some instances. 
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Table 3 shows the percent of variance accounted for 
by the factors on both forms before and after training • 
Inspection of factor loadings of the 65 items after a 
varimax rotation indicated that of the four subtests, only 
the Picture Series ciedriy emerged as a factor- This finding 
held for both forms before and after training. The total 
variance accounted for by the factors v;as about one- 
third, and this percent did not change v;ith training. 



Insert Table 3 about here 



In the pretest analysis of Form A, of the 2 7 items 
whose highest loadings (> .20) were on Factor 1, 25 were 
contained in the Picture Series subtest. Of the 2 3 items 
with high loadings on Factor 2 all but six were Geometric 
Matrix, Picture Matrix, and Geometric Series questions « 
The eight items with high loadings on Factor 3 were those 
which had very high difficulty levels (between .62 and .98, 
uncorrected by chance score) , as revealed by the item 
analysis. The six items with high loadings on Factor 4 all 
had extremely low discrimination indices (between -.0 3 and 
+.18), as shown by the item analysis. 

The pretest factor structure of Form E showed a slightly 
different pattern* Factor 1 comprised 28 items v;ith 
loadings above .20. This factor most nearly resembled 
the Geometric factor of Form A, since all but one of the 
15 items with loadings above .50 were from the Geometric 
Matrix, Geometric Series, and Picture Matrix Subtests. 
Unlike Form A, however, several Picture Series items had 
loadings between .20 and .50 on this factor. Factor 2 on 
Form B corresponded to Factor 3 on Form A and, with one 
exception, comprised items with difficulty levels between 
.61 and .99. 

Factor 3 on Form B was a Picture Series factor, since 
19 of the 21 items with loadings above , 20 on Factor 3 
were Picture Series questions v The Picture Series factor 
accounted for less variance in Form B than ir Form A 
because part of the variance accounted for by Factor 1 
in Form B was due to the high loadings of Picture Series 
items on that factor. Factor 4 on Form B was similar to 
Factor 4 on Form A but consisted of only two items 
(discrimination indiitfes ^ .01 and .06). 

The factor structure of both forms after training 
remained similar to that of Form B before training. Factor 
1 of Form A consisted of 25 items, including 14 non-Picture 
Series and 11 Picture Series items. Factor 2 was made up 
of 20 items, all of which were easy Picture Series items 
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(difficulty levels between .63 and •98). Factor 3 comprised 
11 easy, non-Picture series items (difficulties between 
.52 and • 86 on 10 of the items). Factor 4 had seven items, 
six of which had discriminations between --.01 and *19. 

For Form B after training, Factor 1 consisted of 17 
non-Picture Series and 12 Picture Series items. Factor 2 
was made up of 23 items 22 of which were Picture Series 
items. As with Form A, these were easy items, with diffi- 
culties between ,70 and .99. Factor 3 comprised five 
non-Picture Series items with difficulties between .74 and 
.91, and Factor 4 had eight items, six of which had 
discriminations between .06 and .19. 

Table 4 permits closer examination of the relationship 
between the difficulties and factor loadings of Picture 
Series items. It can be seen that the easiest items on 
this subtest usually had higher loadings on the pure 
Picture Series Factor than on the Geometric and Picture 
Series Factor, although this finding was less consistent 
on the Form B pretest. The most difficult Picture Series 
items most often had high loadings on the Geometric and 
Picture Series Factor. The pure Picture Series Factor contained/ 
for the most part, easier picture series items. The table 
also indicates that Picture Series items whose initial 
difficulty was in the moderate range were more susceptible 
to change with training than items which were originally 
very hard or very easy* 



Insert Table 4 about here 



Initial Differences by Grade and Town 

Means and standard deviations were obtained by grade 
and town on both forms with the same sample which had been 
used for the item and factor analyses before training. 
Two one-way analyses of variance were computed for each 
form to determine differences in initial performance by grade 
and town* 

Table 5 indicates that mean scores on the total Series 
Test were higher for students in Ledyard and Wilton than 
in Hartford and Stamford on both Series forms. This 
difference corresponded to the social class difference 
among these towns revealed by descriptive statistics. 
Mean total test scores by grade showed an upward linear 
trend. Differences by town and grade were significant at 
the .001 level in all analyses of variance. 



Insert Table 5 about here 
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Table 3 

Differences by Tovm and Grade on Total Series Pretest Scores 



Form A Form B 



Mean SD N Mean SD N 



West port 


34. 


30 


J- 5 


.16 


100 




* *• 








0 


Darien 


34. 


36 


i-> 


.65 


310 












0 


Hartford 


26 . 




11 


.12 ■ 


140 


28. 


,46 




12 . 


,48 


93 


Ledyard 


39. 


,26 


12 


.55 


326 


43. 


.33 




10. 


,46 


134 


Wilton 


39 . 


.41. 


1 J 




1 / U 


4 b M 


, 1 / 




8 . 


,60 




Stamford 


26. 


. 36 


12 


.46 


371 


25. 


.83 




12. 


,69 


97 


P 






38.35 


* 








60 


.09* 




df 




5 


,1411 










3, 


344 






Grade 1 


23. 


.44 


11 


.39 


309 




.19 




12, 


.17 


74 


Grade 2 


31, 


.7t 


13 


.82 


427 


35 


.03 




13, 


.38 


101 


Grade 3 


36 . 


.98 


13 


.31 


4 30 


39 


.21 




12; 


.64 


102 


Grade 4 


41, 


. 06 


11 


.4 3, . 


251 


40 


.66 




11, 


.58 


71 



F 119.42* 37.85* 

df 3,1413 3,344 



*£ <.001 
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Effects of Traini ng 

The training study analysis was a four-way repeated 
measures design on the 47 3- subjects in the training study 
sample* Grade / Training Group, and Test Form were the 
between subjects factors; Test Session (pre and post) 
was the within subjects factor- ^ 

Means of trained and nontrained subjectis on the pre- 
and posttest across. Forms A and B are presented in Table 6. 
Trained subjects improved more than nontrained subjects 
in all grade levels; fourth graders, hov/ever, appeared 
to gain the least from training. These findings v?ere 
further explained by the analysis of variance results 
presented in Table 7. It is noteworthy that there was no. 
significant difference by Test Form. Grade and Test Session 
were significant main effects ^ as was expected from the 
cell means. The significant Group X Test Session interaction 
indicated that the trained group had a greater increase 
in mean score from pre- td posttest than did the nontrained 
group. Inspection of the Grade X Test Session interaction 
revealed a downward progression in mean score increase 
from the first to the fourth grade v/ithout regard to 
training group: from the pre- to posttest, mean scores of 
first graders rose six points, second graders rose five 
points, third graders rose four points, and fourth graders' 
scores rose less than one point. The significant Grade 
X Training Group X Test Session interaction showed that 
training was most effective at the first and second grade 
levels. The ratio of mean score increase of the nDn- 
trained to the trained group was as follows: 4:7.5 for 
grade 1; 2:7.6 for grade 2; 2.5:6 for grade 3; and -.4:2 
for grade 4. 



Insert Tables 6 and 7 about here 



Relation ship of Series Scores to Race and Social Class 

For each town except Hartford, for which social class 
information was not available, percentages by race and 
social class were obtained (Table 8) . Social class was 
determined by father's occupation, with the scale employed 
by Project Talent (Flanagan & Cooley, 1966, pp. E-11) . Middle 
class was defined to include managers and professionals 
and lower class to include laborers and skilled and semi- 
skilled workers. It can be seen in Table 8 that the Hartford 
and Stamford students were predominantly black and lower 
class, while the large majority of Westport, Darien, 
Ledyard, and Wilton students were white and middle class. 
Although social class data for Hartford students was not 
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TABLE 6 

Means on Series Pretest and PosttGSt of Trained and Nontrained Subjects 

in Training Study {N - 471) 

Trained Nontrained 



Pretest Po^ttest Difference Pretest Posttest Difference 



Grade 


1 


21* 


17 


28. 


1 

.63 


7, 


.46 


21, 


.12 


25. 


.49 


4, 


.37 


Grade 


2 


31* 


35 


38, 


.98 


7, 


.63 


33, 


.02 


34, 


.96 


1. 


.94 


Grade 


3 


37. 


53 


43. 


.72 


6. 


. 19 


36. 


.90 


39. 


.40 


2 . 


.50 


Grade 


4 


37. 


72 


39, 


.68 




.96 


40. 


.44 


40. 


.04 




.40 
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Table 7 



Repeated Measures Analysis: ■;>:- V.^riance Result^^- for Ti-^iining Study^ 



Source 



Grade 

Group (trained vs. nontrained) 
Form (test form) 
Grade X Group 
Grade X Form 
Group X Form 
Grade X Group X Form 



Sum of square 

336!:*^.0U7 
183. U09 
287.081 

205.368 
406.528 
165.0^5 



df Mean nquctre 



L1218.C1& 
183.409 
287.081 
160. 468 

68.456 
406,628 

55.028 



36.542-' 
0.597 
0.935 
0.523 
0.223 
1.325 
0.179 



Unit 



139681.37^3 



455 



306.992 



Test 

Grade X Test 

Group X Test 

Form X Test 

Grade X GnoupX Test 

Grade X Form X Test 

Group X Form X Test 

Grade X Group X Form X Test 



3360.535 
793.010 
733.066 
6.364 
82.004 
284.031 
8,017 
200,1^9 



3360.535 
264.337 
739". 068 
6.364 
27.335 
94.677 
8 .017 
66,730 



94.965**"*^ 
7.470'""' 

20.885'^*-'- 
0.180 
0.772 
2.675*> 
0.227 
1.886 



Test X Unit 



16101.148 



455 



35 • 387 



Total 



196638.375 



a 4 

An unweighted means solution was used, 

-£<.05 
<.001 



941 



208.967 
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available ; the Hartford school from ^A^nic}l this sample was 
drawn is in an inner city black area. 



.nsert Table 8 about here 



Since the correletion between scores cn the two Series 
forms was high but the- pretest mean on Forirt B was 2,14 
points hig}iei: than that on Form A, scores on both forms 
were pooled and the 2.14 difference - ^vas added to scores 
on Form A. Graphs were drawn to fi-how the mean pre to post 
differences on these pooled? form-adjusted Series scores 
for the trained and non-trained groups in each grade 
level in the predominantly middle and lower class towns. 
In these graphs Hartford and Stamford students'" scores 
were combined. Similarly, Darien, Ledyard;. and Wilton 
students' scores v;ere combined ^ to investigate further 
possible social class differences. 

Figure 1 shows that on the Total Series, training 
resulted in the greatest mean score increase for second and 
third graders in the lower class coiturLunities . In the middle 
class tov/ns, first and second graders showed the highest 
mean increase- The fact that fourth graders improved 
little with training, regardless of social class, revealed 
a ceiling effect of the test; i.e. , training did not appear 
to be beneficial after the third grade. 



Insert Figure 1 about here 



For the 15 matrix items the results for the lower 
class sample were about the same as those on the total 
test. The middle class trained students showed the greatest 
increase on these items in the second and fourth grades, 
while the non-'trained first graders improved more than the 
trained first graders. The Picture Series and Geometric 
Series graphs were very similar to the graph for the total 
test, reinforcing the notion that training did not greatly 
contribute to better performance after the third grade. On 
the Geometric Series Subtest, in fact, the non-trained 
middle class fourth graders showed a greater pre to post 
increase than the corresponding trained group* 

Additional analysis of social class differences was 
performed by computing the pretest mean on the form- 
adjusted total Series scores for middle class students in 
the four predominantly middle class communities (Westport, 
Ledyard, Wilton, and Darien) . The percent of students 
falling above and below this mean before and after training 
was calculated by social class in each town. The aim of 
this analysis ^7as to determine whether lower class students 
attained a Series score after training which was equal to 
or above the average initial scores of middle class students. 







?iace i 


and Social 


Class 


'Percentage 


s by Tovm 


















Social Class 
















Sei'ii - 






Profes- 






White 


Black 


N 


Lar-orers skilled 


Skilled 


Managers 


sionals 




Westport 


83.3 


16 . 7 


102 


9.3 


8.0 


24 , C 


34 . 7 


24.0 


75 


Darien 


100.0 


0,0 


328 


> 1.6 


3.9 


15.2 


52.9 


26.5 


257 


Hartford 


1.3 


95,7 


155 














Ledyard 


99*7 




289 


1.1 


3.2 


28,9 


25,8 


41.1 


190 


Wilton 


97.6 




207 


0.0 


4.3 


6.1 


58,3 


31.3 


163 


Stamford 


23.8 


76.2 


479 


•ir^ /-I 
^3D . A 


31-7 


24.9 


&.0 


1.2 


334 
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grade 



■niiiiiiitfliiK hartford- Stamford (lower class) NT 

^ggg^^^gg^^ hartford- Stamford (lower class) T 

iMiMMHiff darien-iedyard- Wilton (middle class) NT 

H^^^^^M darien-ledyard- Wilton (middle class) T 

Fig. !• Mean Pre- to Posttest Difference of Trained 
and Nontrained Subjects of Total Series Test. 
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Table 9 presents Series scores before and after 
training by social class for each town. It was anticipated 
that scores of lower class children could be raised with 
training to equal the pretest scores of middle class 
childre^n. For the total sample, this result occurred for 
children of skilled workers but not for children of laborers 
or semi-skilled workers , although these latter two groups 
improved considerably with training. It is noteworthy 
that within each town the expected result was achieved in 
all communities except Wilton , where the discrepancy between 
initial scores of lower and middle class students was the 
greatest. After receiving training , 42.4% of the trained 
students in Hartford, which was largely black and lower 
class, surpassed the pretest mean of middle class students; 
only 26.4% surpassed this mean before training. Of all 
lower class students in the sample (with Hartford included) , 
51.3% exceeded the middle class pretest mean after training, 
in contrast 'to 34.9% who surpassed this mean before 
training. 



Insert Table 9 about here 



The relative contributions of race, social class, 
and race-social class interaction to Series performance 
before and after training were examined by using these three 
independent variables in two stepwise multiple regression 
equations. In the first equation the adjusted pretest 
score was the dependent variable; in the second equation, 
the adjusted posttest score was the dependent variable 
and the adjusted pretest score was entered before the other 
three variables . The unique variance contributed by each 
independent variable in the equations was determined. 

Table 10 shows the results of the stepwise multiple 
regressions on Total Series scores before and after 
training. Social class contributed the most to pretest 
scores (r2 = •OS), , although the unique variance of race 
and race-social class interaction were also significant. 
The pretest score ^iccounted for 52.3% of the variance in 
scores after training. With pretest score held constamt* 
social class was the best predictor of posttest score (r^ - 
.05), although the other variables were again significant* 



Insert Table 10 about here 



Relationship of Series Scores to IQ 

Means and standard deviations were calculated on four 
separate IQ test scores. Scores from these tests were 
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Table 9 

Series Scores by Social Class before and after Training 



Before training 
% below % above 



mean 



mean 



N 



After training 

% belov; % above 

a a 
mean mean 



N 



Total sample 



1. 


laborers 


67 


.0 


33. 


0 


134 


58 


.5 


41 


.5 


106 


2. 


serai-skilled 


67 


.4 


32. 


6 


135 


53 


.0 


47 


.0 


102 


3. 


skilled 


53 


.7 


46. 


3 


205 


35 


.4 


64 


.6 


178 


4. 


managers 


38 


.0 


62. 


0 


326 


14 


.0 


86 


.0 


284 


5. 


professionals 


33 


.7 


66. 


3 


219 


11 


.3 


88 


.7 


169 



Wsstport 

Lower class^ 
Middle class 

Darien 

Lower class 
Middle class 

Ledyard 

Lower class 
Middle class 

Wilton 

Lower class 
Middle class 



48.4 
34.1 

52.8 
45.6 

30.2 
30.7 

58.8 
23.3 



51.6 

55.9 



41.2 
76.7 



31 
44 



47.2 53 
54.4 204 

69.8 63 

69.3 127 



17 
146 



33.3 66.7 30 
14.6 85.4 41 



33.3 
12.4 



66.7 
87.6 



48 
170 



14.5 85.5 55 

12.9 87.1 101 

35.7 64.3 14 

8.3 91.7 121 



Table 9 (continued ) 



Before training After training 

% below % above % below % above 

mean^ mean^ N mean^ mean^ N 

Stamford 

Lower class 70.6 29.4 310 58,6 41,4 239 

Middle class 70.8 29.2 24 45.0 55.0 20 
Hartford 

Lower class 73.6 26.4 201 57.6 42.4 99 

Mean was calculated from pretest scores of children in 
Westport, Darien^ Ledyard, and VJilton whose fathers were managers 
or professionals. 

^Lower class comprises categories 1 to 3; middle class 
comprises categories 4 to 5. 
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Table 10 

Results of Stepwise Multiple Regressions on Series Scores 



!• Dependent Variable: Series Pretest Score 

Mean 



Source df 


% variance 


% variance 


F 




Race (unique) 1 


.008 


.008 


14 


.92* 


Social Class (unique) 1 


.0 51 


.051 


95 


.09* 


Race X Social Class (unique) 1 


.025 


.025 


46 


.61* 


Common Variance (Race + social (1) 


.030 


.030 


55 


.94* 


Class + Race X Social Class) 










Total variance accounted for (3) 


.114 


.038 


70 


.85* 


Error 1652 


.886 


.000536 






II. Dependent Variable: Series Score 


after Training 




Pretest (unique) 1 


.324 


.324 


972 


.97* 


Race (unique) 1 


.009 


.009 


27 


.03* 


Social class (unique) 1 


.050 


.050 


150 


.15* 


Race X Social Class (unique) 1 


.019 


.019 


57 


.06* 


Coiranon Variance (Race + Social (1) 


.204 


.051 


153 


.15* 


Class + Race X Social Class) 










Total variance accounted for (4) 


.606 


.152 


456 


.46* 


Error 1181 


.394 


.000333 







*£ <.001 
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treated separately for two reasons: (a) since students 
in different towns had received different tests, the type 
of test was confovinded with town and therefore with 
social class ^ and (b) correlation coefficients among the 
Kuhlmann- Anderson, the Otis, and the Lorge--Thorndike 
are only moderate, ranging from .41 to .61 r depending 
on the form given ( Technical Manual , 1963, pp. 17-18? Lorge 
& Thorndike^ 1962, p. 21) * No IQ information was available 
for Hartford students. 

To assess the relationship of IQ and Series scores, 
correlation coefficients were obtained betv^reen each of the 
four IQ test scores and adjusted Series scores before and 
after training^ In addition, four multiple regressions 
were run in which the adjusted posttest score was the dependent 
variable and the adjusted pretest score and scores on one 
IQ test were the two independent variables ♦ Pretest score 
was entered first and the lanique variance contributed by 
each IQ score was determined. 

Table 11 shows the means, standard deviations, 
correlations with Series total scores, and unique variance 
contributed to Series scores after training for each of the 
four IQ tests • It can be seen that the mean IQ in Stamford 
(where the sample was predominantly black and lower class) , 
was considerably lower than the mean IQ in the middle class 
towns* All four test scores correlated significantly with 
Series scores before and after training. With the variance 

due to the pretest removed, results of the regressions 
showed that all IQ scores except the Otis contributed 
significantly to performance after training. 



Insert Table 11 about here 



Relationship of Series Scores to Reading and Vocabulary Scores 

The relationship of Series scores to comprehension 
and vocabulary scores on the Gates-MacGinitie Reading Test 
can, in one sense, be considered evidence of concurrent 
validity of the Series Test, It must be recognized, 
however, that the former is a verbal test and the Series 
Test is nonverbal. 

Initially, the form-ad jousted pretest and posttest 
scores on the Series were correlated with the tv;o Gates- 
MacGinitie subtest scores. Stepwise multiple regression 
equations were then formulated, with comprehension and 
vocabulary scores as the dependent variables. Independent 
variables were entered into each equation in the following 
order: IQ, social class, race, social class-race interaction. 
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membership in a reading enrichment program (ClRpj', and 
Series pret:est score. The order of entry of these variables 
was determined by hypotheses concerning the relationship 
between each variable to the dependent variable, as well 
as by previously demonstrated statistical relationships 
among the independent variables. Five equations were 
constructed for both dependent variables, one for each 
type of IQ test given to different groups of students. 

Pearson product-moment correlation coefficients between 
Series and Gates-MacGinitie scores are presented in Table 12. 
Fisher's £ to 2^ transformation was used to obtain the 95% 
confidence interval of the two coefficients between reading 
comprehension and Series scores before and after training. 
Since these two confidence intervals did not overlap, 
the relationship between reading comprehension and Series 
scores after training was significantly higher than that 
before training. On the vocabulary measure, however, the 
confidence intervals of the two coefficients overlapped 
a .05 interval* Although the relationship between Series 
and vocabulary scores increased after training, this increase 
was not statistically significant. 



Insert Table 12 about here 



Results of the multiple regression analysis are 
presented in Table 13. Score on the group IQ tests, 
regardless of the test used, was found to be the best 
predictor of both comprehension and vocabulary scores. 
Social class was also a significant predictor in all ten 
equations. Race, race-social class interaction, and member- 
ship in a reading enrichment program (CIRP group) were 
significant in several equations, although these variables 
accounted for a relatively low percent of the variance 
in both dependent variables . 



Insert Table 13 about here 



Despite the low contribution to total variance of 
race and CIRP group, it should be noted that in Equation 2 
for comprehension {Westport, Darien, and Ledyard) signs of 
the t-tests for race and CIRP were in the opposite direction 
of those in other equations in which these variables 
were significant. That is, blacks and nonCIRP students 
tended to have higher comprehension scores in this analysis, 
whereas whites and CIRP students had higher scores in some 
of the other analyses. 



The Cooperative Individualized Reading Project (CIRP) 
was a reading enrichment progrcuu designed to improve reading 
achievement- CIRP was conducted concurrently with this study, 
and students in some classrooms were participating in both 
studies. 



TABLE 12 

Pearson Product-Mcment Correlation Coefficients betv/een 
Series and Gates-MacGinitie Scores 



Gates -MacGini tie 

Comprehension Vocabulary N 

Series pretest .471* .326* 1228 

Series posttraining .592* .429* 954 



*p <.001 
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Series pretest score accounted for so little variance 
that it entered into only one equation/ in which the t-test 
of its beta weight was only .91 and not significant. 

The Series Test, then/ was significantly correlated 
with Gates-MacGinitie comprehension and vocatbulary 
scores/ when only the zero order correlation is considered. 
Since both the Series Test and the Gates-MacGinitie were 
found to be related to IQ/ social class (and less so to race) 
when these demographic characteristics are taken into 
account the relationship betv/een Series and Gates-MacGinitie 
scores becomes negligible. In other words / a child who 
is middle class, white, or has a high IQ usually tended 
to do better on the Gates-MacGinitie tests regardless of 
his performance on the Series. As has been pointed out 
previously/ it is this same child who attained a high 
Series score as well. 

Discussion 

The two forms of the Series Test proved to be highly 
reliable/ both in internal consistency and over time. 
Equivalence of forms was demonstrated by high alternate- 
form correlation coefficients/ parallel item loadings on 
the first principal component/ parallel item difficulties/ 
and lack of significant difference for test form in the 
training study analysis. 

Factor analysis empirically confirmed only the Picture 
Series as a distinct entity/ casting doubt as to the 
appropriateness of separate scores on the other three 
subtests. Training had little effect on the factor 
structure and on the difficulties or principal component 
loadings of very difficult items. 

Students who got the highest scores both before and 
after training came from a high socio-economic background/ 
were white/ and generally had high IQ scores. Training/ 
however/ was able to boost the mean scores of lower class 
students to the pretest level of middle class students 
in five of the six tovms analyzed. 

A ceiling effect was demonstrated by both the 
training study analysis and the graphs contrasting scores 
of middle and lower class groups. Training was most 
effective for second and third graders in lower class 
towns and for first and second graders in middle class 
towns. These analyses suggest that the training on the 
Series Test is of little benefit beyond the third grade and, 
for middle class students/ beyond the second grade. 
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To explore the question of a ceiling effect further, 
the Series Test was given to seven adult college graduates. 
All got nearly perfect scores; those items answered incor- 
rectly were the items v;ith the lowest difficulty levels in 
the present analysis. It would appear then, that some items 
in the Series Test as presently constructed are geared 
tov;ard a highly educated test^-taker ^ while others are appro- 
priate for children in the primary grades ^ This theory 
could explain why the four factors accounted for only a 
third of the variance in scores attained by the first 
through fourth grade students in this sample. 

Because of the ceiling on Series Test scores, and 
because of the relationship of Series scores to race and 
social class, the Series Test appears to be a less useful 
measure of learning potential than either the Kohs Block 
Designs or the Raven Progressive Matrices. 
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Instructions for Administration of the 
Series Learning Potential Test 

For successful administration of the Series Learning Potential 
Test, the examiner must arouse the curiosity* and involvement of the 
subjects simultaneously by creating a relaxed atmosphere in which 
the challenge is non-threatening to the children. The test (called 
"The Series Game") lends itself well to these requirements due to 
its game-like nature. The coaching session is an opportunity for 
loose, active involvement, while the post-test is an opportunity for 
a more relaxed second effort at the task. 

The Series Learning Potential Test is administered in three sep- 
arate sessions - the pre-test is administered on the first day, the 
coaching on a second day, and the post-test on a third day (within 
three days, or within the range of a week for the cycle of testing).- 
The schedule of these sessions should not interfere with "popular" 
activities isuch as gym and art. In the case of younger groups (ages 
7 - 9) it is recommended that the sessions be held early in the day. 
The test should be given in a room free of distractions , and the 
children should be seated so they can watch the examiner. Also, 
there should be enough space for the examiner to walk among the 
subjects. The optimal size of the group is between 8 and 15 subjects. 
An experienced tester can sometimes manage a group of 2 5 to 30 chil- 
dren. With young children, it is highly recommended to have no more 
than 10 - 12 subjects in the group- When testing large groups (if 
this is unavoidable) the tester should be assisted by a person who 
is familiar with the Learning Potential measurement in all three 
parts of the testing. The test user should try to test the group 
in their usual classroom and to have the teacher present (even though 
she need not participate in the administration) . 

With the setting arranged, it's up to the examiner to make the 
situation interesting and relaxed. The examiner should explain to 
the subjects what to expect in each session. The terminology should 
be simple, referring to test items as puzzles and to the coaching 
as the "game of learning tricks" for greater enjojmient the second 
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time around. We recommend that the tester should try to pick up 
the names of the childreii early in the session. 

During the testing 5 the examiner should walk around the room 
to make sure ins true tions are understood and followed. Occasionally 
the tester should reinforce indi.vidual children by saying ''good" or 
"that^s right'' or give individual attention to children who seem to 
be nervous or have difficulties, i.e., repeat test instructions. 
It is probably better to exclude resistant and/ or hyperactive children 
than making them take the test in an orderly way against their will. 

Specif ic Instructions 

Pr e- Te st Instructions 

Once all the subjects have settled down with erasers and sharpened 
pencils 5 the examiner jnakes her introductory remarks. These comments 
refer to the test items as puzzles or^ games, and emphasize that the 
subjects will later be shown tricks which enable them to play the 
game better a second tim'e . These comments could be flexibly 
changed to suit the group address ed, 

"Today you're going to do the puzzles in the Series Game book 
(indicate pre-test booklet). First you will do them on your own, 
and later 1^11 show you tricks you can use for solving the puzzles. 
The next tim^i' I come you'll work on puzzles like these again on' 
your own, so you'll have .a chance to use the trickf^3." 

Pass out the test booklets and ask the subjects to fill in 
their first and last names 5 etc. Spell out the teacher ^s name on 
the blackboard and. point to the appropriate lines on the face sheet 
as the subjects ai^e VA^riting. Wal|<: around the room to see that the 
writing is legible and that both first and last naities have been 
wr.itten. Return to the front of the room where all the subjects 
can see clearly. When all the children are ready, give the pre- 
test instructions 5 holding the test booklet up to demonstrate the 
directions . 

You explain to the. subjects the nature of the stimuli and the 
requirements of the task *- to find the picture that belongs in the 
empty space , and circle it. Your instructions should clearly distin-- 
guish between the puzzle row (the series itself) and the answer options. 
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^'Now turn to page one and look at the first row. What do you 
see? You see a series of pictures and an empty space. What you 
have to do is find the picture that belongs in the empty space. 
That picture is one of the pictures on this side of the page (right 
side). So this rov; on the left^ is the puzzle (point) and these 
are the choices (point). Only one of these pictures fits in the 
empty space, and you must find which one is the best. Look at the 
pictures in the puzzle and ask yourself, 'What comes next, what 
fits in the empty space?' then look at the choices and circle the 
picture you think is the right answer. Which of the choices is the 
right answer for the first row? Is it number 1, 2, 3, or 4? (Point 
to each of the numbered choices). That's right, it's number 3. 
Put a circle around number three. (Walk around tie room to be sure 
each child has done it correctly). Now you can do the rest of the 
book by yourselves the same way. Each row is a different puzzle 
which has a different answer. Look at the puzzle with the empty 
space, ask yourself what picture comes next and fits in the empty 
space. Then look at tlie choices and circle the right answer. 
Remember that there is only one right answer. Be sure not to skip 
a x^ow, " 

The test lasts for 30 minutes or until all but one or two sub- 
jects have finished. During the test, walk around the room to be 
sure that the subjects cix^cle only one answer, that they do not 
circle . pictures in the series puzzle itself, and that they do not 
consistently circle the same position. You can repeat the instructions 
and reinforce children, but do not offer any information beyond what 
you have given in the initial instructions. 
Coaching Instruct ions 

The coaching session, administered to the entire tested 
group, provides "tricks" for approaching picture series problems. 
The group learns to approach, and solves together, seventeen items. 
The following principles are emphasized: 

1. In each series "something changes," and one must identify 

the change in characteristic (e.g,, changes in object, size, 

color , etc , ) . 

2* The change in every series has a "tune," or "rhythm*" One 
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must discover the tune and be able to sing it to himself. 
Using the tune, one can go beyond the pictures in the series. 
3. Most series have more than one "tune;" one must first 
identify the different *^tunes,'' and then sing each separately* 
Each isolated "tune" will include only one change dimension. 

For every "tune"one sings, he can cross out those choices 
which are incorrect for that tune. The remaining uncrossed 
choices can help decide which "tune" to sing next. 
5. "Tunes" must not start at the beginning of the series, and 
they can be sung in any direction. 

In short, the tester coaches the subjects to identify the con- 
cepts (color, size, object, etc.) which change in a series using their 
sense of rhythm, to isolate the concepts by separating the tunes, and 
to eliminate wrong choices for each step. Emphasize the point of 
looking to see what changes - of saying a separate tune for each thing 
that changes . 

The coaching session shou.ld be carried out as a group experience 
that involves all subjects. Distribute the booklet entitled "Tricks 
for the Series Game." Inform the children about it and ask them not 
to proceed ahead of the group. The coaching is carried out much as 
a regular lesson, and the children should be encouraged to "sing the 
tunes" together. At the same time, you should call on individuals 
(active and passive, bright and less bright) to lead the class in 
identifying and singing the tunes. 

A set of complete instructions for the coaching booklet follows. 

With slower groups, the instructions should be followed to the letter. 

With other groups, the tester should use his judgment to determine 

the amount of repetition. "Repetition" refers mostly to the number 

of times the same tune is repeated. If the group shows signs of 

to 

boredom and most subjects seem to catch on che strategies, the tester 
should skip a few items, e.g., numbers 13, 14 or 15. In any case, 
the last item should be included in coaching as it shows the use of 
starting the tune at the end of the series. 

Instructions for Coaching 

"In the booklet that you jJust completed, you saw rows of pictures 

O 
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with an empty space in each rown. You had to find the picture that 
fits the empty space and completed the series and then circle it. 
Now we will go through this booklet together and I will show you 
some tricks that will help you find the right answer for each row. 
If you use these tricks, the problems will be very easy. Look at 
the first rov? in "Tricks for the Series Game.'^ What do you see? 
(Tester should .encourage a group response here and in the following 
problems but at the same time should, also learn some of the subjects^ 
names and call on specific individuals at times. The subjects must 
ansvjer with the coacher and not go be end the example with which 
the coacher is dealing. The use of the strategies must be enforced 
in this way.) That * s right, a row of flov/ers. Now let's look 
at the same row again and as we look we can say what each picture 
is (point to each picture as you go along saying the name of the 
picture alcnd) f lovjer , flower, flower, flower^, flower, flower. We 
can say that the tune is flov^er, flower, flower, flower, flower, 
flower. (Go through the series saying the tune aloud with the subjects 
once more and V7hen you reach the empty space ask what goes here.) 
Let^s repeat the tune of the row once together (this time continue 
the tune to automatically extend beyond the empty space). So now 
we see that flower fits in t]ie empty space. Now look at the 
choices on the other side. VJe know it can't be number 2 because 
that's an apple. Cross it out. (Tester should walk between aisles 
to make sure everyone gets the idea of crossing cut the wrong 
answers.) Is it number 1? No. Why? That's right, it's too small. 
Cross out number 1* What's left? The .big black flower and the 
small white flower. Wh.ich one is the right answer? That's right, 
number 3 is the right answer. Circle it. 

"Now look at row number 2. What do you see? Yes, there are 
teddy bears and clocks, two different kinds of pictures. Let's go 
through the row and say the tune. Teddy bear, clock, teddy bear, 
clock, teddy bear, clock. (To the coacher: do you feel the tune? 
Tune must be read rhythmically to catch the class's interest.) Once 
more, teddy bear, clock, teddy bear, clock, teddy bear, what goes 
here? That's right - clock. Now look at the choices. Since we 
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know the right ansv;er is a clock vjhich answers do we know are wrong? 
Yes, we know that number 1 and 3 can't be right because they're 
both teddy bears , so cross them cut. Wharfs left? The small clock 
and the big clock. Is it nuiribcr 2? No. Why? It's too small. Cross 
out number 2. Nov; vvhcit^s left? The bi^ clocks number This is 

the right answer so circle it. (Be sure the children pick up the 
rhythm. You might move your hands in time to the rhythm as you say 
the series out loud with the kids, Coachei^ should ^amphasize 
questioning the class but at the same time should call on individuals 
whose attention might be wandering. Coaching must be made exciting 
but must not move so quickly ' tliat the slower children are lost.) 

"Ij-^ the next few problem.s 1 will shov/ you that there are 
different kinds of tunes which we must look foi"^ in the rows. We have 
just seen that the picture can change from teddv bears to clocks. 
In row number 3 we see a different kind of change. Can someone 
tell me what ^phanges here? That's r^ight, the color changes from 
black to V7hite, Does the picture change? No* All the pictures 
are birds so we are just going to forget about the pictures and 
look at the color tune. Remember we done ' t say bird each timej we 
just say the color c (Tester should make sure everyone just says 
color to avoid confusion later on when more than one tune are present, ) 
Let's say the color tune. White 5 blacky white, black, v/hite, black. 
(Tester should always continue the tune beyond the empty space.) 
Again. White, black, white, black, white, what comes next? That's 
right - black. Black is the right answer so which of the choices 
can we cross out? Number 2 and 3 - because they're vjhite. What's 
left? The big black bird and the small black bird. Which is the 
right ansvjer? Number 1 is the right ansvjex"^ because the birds 

are big. Cross out number then and circle number 1. 

"Turn the page* Now let's look at row 4, What do you see? You 
see a row of balls, so we know the picture doesn't change. What 
changes? That's right - size. The balls are big and small. Does 
color change? No. Now let's read through the row and say the size 
tune. Remember we don't have to say ball each time because we're 
just looking at the size tune. Big, small, big, small, big, small, 
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(Tester should always continue the tune beyond the empty space.) 
One more time. Big, small, big, small, big, what comes next? 
Small, Now let's look at the choices. VJe know that the answer 
has to be small so which ones can we cross out? That's right - we 
can cross out numbers 2 and 3 because they're both big. What's left? 
The small black ball and the small white ball. Which is the right 
answer? That's right. The small white ball because all the balls 
are white, so cross out number 1 and circle number 4. 

"What do you see in row number 5? Yes, there are pictures of 
a flower, a dog and a man. We've seen rows with one kind of picture 
and rows with two kinds of pictures. Now there are three kinds of 
pictures in this row. Does the color change? No. Does the size 
change? No. Something else is different. Can soineone tell me 
what it is? Yes, the empty space comes in the middle of the line 
and not at the end. This makes the problem a little harder but we 
use the same tricks. Let's read the tune together. Flower, dog, 
man, flower, dog, man, flower, dog, man. Again. Flower, dog, man, 
flower, dog, man, what comes next? That's right - a flower. Let's 
look at the choices. We know that a flower is the right answer 
so what can we cross out? Yes , we can cross out everything except 
the flower, number 3, the correct answer. Now circle the flower. 
Now let's review. What are the things that can change? That's right. 
Color, size, picure. That means there can be three separage tunes. 

"Let's look at row 6. What changes? Size. Does anything else 
change? No. Let's read the size tune* Big, small, small, big, small, 
small, big, small, small. (Even if the written series is not complete, 
tester should always read a complete tune.) One more. Big, small, 
small, big, small, what comes next? That's right - small. Look at 
the choices. What can we cross out? We can cross out number 2 and 
3 because they're both big. Now which answer is the correct one? 
Number 1 is right. Why not ^4? It's facing the wrong direction. 
Circle number 1. 

"What changes in row number 7? That's right - the pictures change. 
Does color change? No. Does size change? No. Where's the empty 
space this time? That's right, the empty space comes in the 
beginning. Here's the trick when the empty space comes first. 
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Start at the end of the rov-; instead of at the beginning when we 
x^ead the tune. Let^s x'^ead the tune together- going frorn the end. 
Lady, lady, bird, ba3.i, lady, lady, bird, ball. Again. Lady, lady, 
bird, ball, lady, laciy, bird, wnat comes ne?:::? That's right - ball. 
Ball is tlie right ansv?ver'. Let's look at the choioes- Which ones 
can v;e cross out? VJe can cros.^^ out number 1 and - because they're 
birds and number 3 because that ^ a lady. What's left? Ball. 
Pat a circle diround number 2. Tliat. lAie correct answer - ball. 

"Now let^s lock at rovj number 3 v^.nd see vjhat changes here. Can 
someone tell me V7hat changes? Yes, the posit.ion changes. Some hands 
go up and some go down. Doe^-; anything else change? No > Then 
let ^3 go through .the row reading the tune for position and saying 
only up or down for each picture. OK, t.he first one goes up so we 
say up, down, up, down, up, down. Let's go through the series once 
more. Up, down, up, down, up, down. What fits in the empty space? 
That's right - we need an up. Nov; look at the choices. Wbicli ones 
can we cross out? Yes, cross out 2 and 3 because they 2o down. 
Now, which is the right answer? Yes, 1 is the right answer so cross 
out number U and circle number 1. Why is 4 wrong? That's right - 
it's facing the wrong way. 

"Now we see that thei^e are a number of triings that can change 
in a row: the size, the picture, and the color and position. (in 
the following rows in which the-re are more than one of these tunes, 
the Goacher should always stress that he prefers the subjects to 
start with color, size, or posi.tion and end with picture. T'nus 
the subjects will learn to look for all tunes and not stop after 
reading the most obvi.ous - the picture tune.) In row S vje are 
going to see that sometimes more than one thing changes in a row 
which means we have to look for more than one tune in the rovj. For 
example, things can be black and white and also big and small, so 
now we will look at each kind of change separatel^;^ and then it 
\-jill be easy to find out what the right answer is. Now when we look 
at a series we will find all the kinds of changes there are and 
then we will look at each one separately- Look in row number 9. 
What kinds of changes do you see? That's right, the kinds of 
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pictures change. There are teddy bears ard dogs- What else changes? 
Yes 5 the color changes irora irlack to vjhite. Does anything else 
change? No. Lee's just look at the color change i'lrsr. Can someone 
read the tune for color? White, blaci:. whit?:. bJack, wliite, black , 
white, black. Again, Whire, black, wliite, b'lack, what comes next? 
Yes 5 vjhite. Now let ^ s look at the choices. Which ones can we 
cr^oss out? Yes J we can cross out nurnberrs 2 and •+ because they art- 
black. VJhat's lefL'? A dog and" a teday bear. L'ow let^s go back 
and read the picture tune l:.c we* can choose the riglit answer. Teddv 
bear 5 teddy bear ^ dog, dog , teddy bear^ teddy bea; , dog. dog. Once 
more. Teddy-bear, teddy bear, dog? oog , vvhat conies next? Tha.t ^ s 
right - teddy bear. Now lool: at the choices, C^'css out the dog. 
and circle the right answer, the teddy bear. 

*'Now lock at row number 10. What kinds of changes do you see? 
That\s right - the pictures change from keys to planes. What else 
c.ha.nges? The size. Does anytl'iing else change? No. Let's look at 
the size tune first. Big. big, small, small, big, big, siaall, small. 
Once more. Big, big, small, small, big, big, small, what comes 
next? That ^ s right - small. Now look at the choices and v/hat can 
we cross out? Yes, we can cross out numbers 1 and U because 
they^re big and we want a small for the -..^m^pty space. What^s left? 
A key and a plane. Now we must go back and read the tune for pictures 
to decide between the key and the plane. Key; plane, key, plane, 
key, plane, krey* plane. Again. Key, plane, key^ plane, key, plane, 
key, what comes next? That's right - a plane. Mow we can cross 
out the key and circle number 3, the plane. 

"Look at row number 11* What do you see? Apples, Does the 
picture change? No. V?hat changes then? The size. V/hat else? 
The color. Now let^s look through the row saying the color tune. 
White, white, black, white, whi.te, blacks/white, v/hite , black. Let's 
read it once more. V7hite, white, b]ack, white, white, black, white, 
what comes next? Yes^ white. Now look at the choices. We know 
that the right ansv^er is white so which ones can we cross out? 
That's right - we can cross out numbers 1 and 2 because they're black. 
What's left? A big apple and a small apple. Mow we must go back 
through the row once more to decide on the right answer. This time 
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v;e will read the tune for size. Big, big 3 big, small, small, small, 
big, big, big. Once more. big. big, bi^, siTiall, small, small, big, 
what comes nexx? Ye.L-, big is right. Kcv-? v;v: can cross out tne small 
apple and circle the big apple, the correct answer. 

"Now let's go to rov? 12* V;hat ciianges here? Yes, the picture 
changes from cats to boys. What else changes? Ye5. the size 
changes. Does the color rhange? No, they^re c-.il white. Does 
the position chaj*}ge? No, Then let ^5 start xvirh the tune for size. 
Can someone say the tune for size? (The coach er must constantly 
check the extent of part icipaT.ion and call on the inattentive ones. 
No one should be lost at tl'tis stage of the coaching.) Big, big, big, 
small, small, small, big, big, big. Again. Big, big, big, sm.all , . 
small, small, big, big, vjhcit comes next? That's right - big. Now 
look at the choices. V/hich ones can 'we cross out? That's right - 
cross out numbers 2 and ^1 because they* re small and we need a big. 
VJhat's left? A cat and a boy. Now we must go back and read the 
tune for picture to decide on the correct answer. Cat, boy^ cat, 
boy, cat, boy, cat, boy, cat. Again. Cat, boy, oat, boy, cat, boy, 
cat, boy, what comes next? That's riglrt: - a cat. So now we knovj 
that number 1, the large cat is the riglit ansv/er. Circle num.bei^ 1. 

"Nov7 look thi^ough row 13, Tell me what changes. That's 
right - the picture changes. There are birds and cats. What else 
changes? Color changes. There are whites and blacks. What else? 
That's right - si;-^e changes. Does anything eJ.se change? No. So 
in this row we can see that vje have three different tunes that v^7e 
must do separately. Ifew let's go through the row looking at the 
size first. Big, big, small, big, big, h^.Tall, big, big, small, big, 
big, small. You see I say big and small without looking at what the 
picture is or what the color is. Then 1 wi.ll go back and look at 
each of those tunes separately. Let * s say the size tune once more. 
Big, big, small, big, big, small, big, big, small, what comes next? 
That's right, big- Now look at the choices. Which ones can we 
cross out? Yes, we can cross out numbers 2 and 5 because they* re 
small. Now let's go back through the row reading the tune for 
color. White, black, white, white, black, v/hite , white, black, white. 
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white, black. Once more, White, black, vjhite vjhite> black, white, 
v/hite 5 black 5 vihi-te^ what :::omes next? That^s xvight - white. Mow 
look at the choices and v/hat other ones can we ores?; cut? Yes, 
we can cross out numbers 3 and because they^re blnckr" Wliat^s left? 
A cat and a birdl So nov; ler'c; reac the t:une for pictures to 
decide on the right ansv;e.p , Hird. bird , bird? cat, cat, cat, bird, 
bird, bird, oat, cat, cat. Again. Bir^-^ , bir^i? bii'.j , cat, cat, cat, 
bird ^ bird, bird, v;haT oojnr^L; liexx? Tnar'ji rl^^ht^ \zc<t. So cross 
out th-i' bird and circl^:• the ccrvecx ai'isvier^ toe ca*^, jiujnber 1. 

''New let ^ s look at row ].'-t . When the blank is at the taeginn-'ing. 
V7hat trick do v;e use? Thai's '"ig'nt V7e star I: at rho other end, 
Now v7hat are the different: changes in i-ovv^ 1'^? Si^:e changes. Coloz^ 
changes. Picture changes. That's right. Let's start with the color 
tune this time, Reiueinber ■ ve arc going to read eacli tune separately. 
Black, black, white, v/hite, black, black, white, white. Again, black, 
black, vjhj.te, white, black, black? 'white, what conies next White - 
that's right. Now letr's look at the choices- Which ones can we 
cross out? Number^s 1^ 3, and 6 because they're black and we need 
a white. Now let ^ s go back and read the sise tune. Small, small, 
big, small, smalls big; sniali , small, big. Again, Small, small, 
big, small, smalls bigs small ^ what comes next? That's right 
small. Now if we look at the choices ^igain we see that V7e can 
cross ou1: number 2 because we i^^ant a small and number 2 is big. 
Finally let^s go back and read the pictrure tune. Ball, flower, ball, 
flower, ball 3 flower, ball, flower. Again- Ball, flower, ball, 
flower, ball, flower, ball, what comes next? Flower - that's right. 
Now let's look at the choices again. What's left? A ball and a 
flower. Which one is the correct answer? The small white flower, 
number 3 is the correct answer so cross out the small white ball and 
draw a circle around nurriber 3. 

"Now look at row 15. What changes in this row? .The kinds of 
pictures change. There are books, cars, fish and dogs. What\ else 
changes? The size changes. Does anything else change? No. Now 
let^s look through the row saying the tune for size only.- Big, small, 
smll, big, big, small, small, big » big. Again. Big^ small, small. 



big, big, small;, small, vjhc-^t comes n(-:xt? i?ig is right. Look at 
the choices and tell me what we can cross ou!:. Yes, we can cross 
out all The smalls, irambers ^i- , 5 and 5 beca..se we necjd a big for 
the empty space. What^o left? A fish, a dog and a book. Now v;e 
must go through tlie r'ow once more reading rh<:} rune for pictures. 
Book, book 5 car J car, fisii. fish, oog . dog. Again. Book, book, oar, 
car, fish, fish, dog. vhat coruB^i nexi:?' That's right - dog. Now v;e 
know that the right answer is a dog e:o we can Tr-^oss out the fish 
and book and circle number 3, the big vjhite co,^;^. 

"Turn to the last pa;Z;e -cinr] look ax row nuvubwr "iZ* VJhat changes 
nere? Pictures. Color. 5^i:^3. Yes, ti'u-.tVs right. So 'we knov; that 
there are tliree different' vun'r-s that we rnust do separately. Let's 
begiri V7ith the size tune. Big, small., big, small^ big^ small, big, 
small, big, small. Again. Big, small, big, small, big, small, 
■what comes next? Big, that's right. Mow let's look at the choices. 
Which ones can we cross out? Number 3 and 5 because they ^ re small 
and VJe want a big. Now let^s go back and read the color tune. V/hite, 
white 5 black , black , white , white , black , black , v;hite , white . Again , 
White, white, black, blacky white, white, what comes next? That's 
right - black. Now which choices can we cross out? Number 2 can 
be crossed out because tliat^s white. V7hat ^ s left? Apple, flower 
and a bear. Nov? we must read the picture tune to decide on the 
right answer. Bear, apple, flower, bear, apple flower, bear, apple, 
flower, bear, apple, flower. Again. Bear, apple, flov/er, bear, 
apple, flower, w^hat comes next? Bear is correct. Now we can cross 
out the apple and the fbwer and circle the correct answer, number 6, 
the :big, black bear. 

"Let's look at the last row - number 17. What changes in this 
row? The kinds of pictures change. Does anything else change? 
That's right just the kinds of pictures change. So let's look 
through the row now' at the pictures. We see that there are v^irls, 
houses, and cats. Thr€ie different kinds of pictures. Nov; let's 
look through the rov7 and .see how the tune sounds. (This last example 
is a particularly good row to ask an individual to do alone, 
especially if there is one child who thinks he- understands all the 
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strategies to a point of impatience with the tester. If the child 
makes a false start, suggest that he start from the other end and 
remind him that the tune contains three different pictures. When 
he says the tune correctly, repeat it with the whole class.) Girl, 
house, girl, cat, girl, house, girl, cat, girl, house, girl, cat. 
Let's say it once more together. Girl, house, girl, cat, girl, 
house, girl, cat, girl, house, girl, cat. VJhat picture are we 
missing in the series? Cat is correct. Now if we look at the 
choices below, we can see that numbers 2, 3, 5 and 6 are wrong because 
we want a cat. Cross out numbers 2, 3, 5 and 6. Now we have a big 
cat and a small cat. Which is correct? That's right - number 1, 
the big cat is the right answer. It's the same size as the other 
cat in the row* Now you have seen that a row may contain a number 
of tunes and that if we use our tricks the problems are very easy 
to solve • When many things change, such as color, size and picture 
or position, we know we must look at each change separately and cross 
out the wrong answers for each tune. Then after we read all the 
tunes in a row, we can circle the right answer." 

Post-Test Instructions 

The Post-Test should be given within three days and no more than a 
week following the first session by the same tester. The session 
again lasts either 30 minutes or until all but one or two subjects 
have finished. Before the subjects start working, the tester briefly 
summarizes the "tricks" they have learned in the previous session, 
encouraging the subjects to use them and expressing confidence :ln 
their improved ability. Do not test children who were absent in 
the first session. 

Have all the children fill out the face sheet as they did in 
the pre-test. .session and open to the first page. "This book (indicate 
post-test booklet) is similar to the or.e you did before. Remember 
that you hc.ve to find the picture which belongs in the empty space 
and then put a circle around the choice you think is the right anser. 
This time, you should use all the tricks you learned the last time. 
Look for all the different things that change, in the row: color, 
size, or picture. Then sing the tune for each change separately 
O ^id cross out the wrong answers as you go along. Don't 



forget the trick of starting at the other end when the ejripty space 
coines at the beginning of the >"ow. R^'^^niemt-er to circle only one 
answer and not to sl:.ip any rovjs ^ 
Scoring 

The score i;v. the number of. items answered ^or-r'^ectly , Use 
the scoring key and do y.ot rrust your judgment. Give credit only 
when one choice (the correct one) wa:-: cii-cled. Occasionally a 
child may circle a. picture in the ocrieG instead of the provided 
choices. Give credii: if r.he ciioicci in correct anci -:he vonly one 
circled . 

Record the scoras on the face sheets of the pre-test and post- 
test booklets. The foririat is as follov/s: 

7\P (apple) Pre-Test 

Series 



pict. ■ 


items 


1-40 


geo. 


items 




total 


items 


1-50 


Matrices 






pict. 


items 


51-55 


geo. 


items 


56-65 


total 


items 


51-65 



Total items 1-6 5 



TB (teddy bear) Post-Test 





TB 




AP 
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pict . 


items 


l-M 0 


l-UO 


geo. 


items 


m-50 


41-50 


total 


items 


1-50 


1-50 


Ma rices 








pict. 


items 


51-55 


51-55 


geo. 


items 


56-65 


55-65 


Total 


items 


1-6 5 


1-65 
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